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This study seeks to identify factors that influence the perceived complexity of providing 
nursing care to others (who are dependent on alcohol and tobacco) and the confidence 
of undergraduate student nurses to carry out this care. The research project is 
designed to explore whether there is a difference between the perceived complexities 
of 57 different nursing tasks and skills as understood by student nurses and their 
differing ages, gender and types of first language used. By using a probabilistic 
measurement approach (Rasch model), the study seeks to assess whether a scale of 
performance for learning can be constructed based on the difficulty of nursing care 
required and the self-rated capacity of the undergraduate nursing students to provide 
the nursing care. Outcomes of the study suggest that nursing students do differ 
significantly both in how they view the complexity of providing nurse care and their 
capacity to provide that nursing care. Recommendations are made for informing 
nursing education programs, in a bid to make nursing care as it relates to others who 
are substance dependent, more effective. 

Raseh sealing, partial eredit model, attitude measurement, aleohol and tobaeeo dependenee 


INTRODUCTION 

This paper explores the applieation of the Raseh model to develop and subsequently to analyse 
data derived from a series of rating seales that measure the preparedness of nursing students to 
engage with patients who are dependent on tobaeeo and aleohol. Brief eonsideration is first given 
to the relationship between affeet and learning together with an overview of how the rating seales 
used in this researeh were developed in terms of their eontent and proeesses. A literature review 
then explores how nurses’ attitudes impaet on the eare delivery to patients who are substanee 
dependent. Emphasis is then plaeed to how the prineiples of Raseh sealing ean be applied to rating 
seale ealibration and analysis. Data derived from the applieation of the Nurses’ Clinieal 
Confidenee Seale (NCCS) are examined for the evidenee of differentiated item funetion and 
implieations of the study for edueational programs is explored. 

BACKGROUND TO THE STUDY 

Useful edueational information may be gained by asking partieipants to eomplete attitude rating 
seales at different times during their learning or employment. This is done to identity their 
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attitudes (positive or negative) and values that underlie their thinking or to estimate the intensity 
of their attitudes and to gauge the consistency of their attitude toward some belief or value. If done 
over time, measurements indicating changes in participant values and attitudes can provide an 
estimate if learning is taking place. 

Attitude measurement of nurses and how they relate to others who are substance dependent is 
important, because there is now a body of knowledge that suggests the attitudes of nurses towards 
substance misuse in the mentally ill, are generally sub optimal and it influences the quality of 
nursing care provided (Foster and Onyeukwu, 2003). The outcomes of substance abuse attitude 
surveys (SAAS) given to both undergraduate and post-graduate students were not significantly 
related to the student’s age, gender, or their level of experience according to one English study. It 
found instead, that post-graduate students were less moralistic and more optimistic of treatment 
outcomes than undergraduate students (Richmond and Foster, 2003). 

Despite concerted efforts to help undergraduate nurses deal successfully with the care of drug 
dependent patients through educational programs, difficulties in the management of nursing care 
persists (Happell and Taylor, 1999). Moreover, nurses believe they are constrained to conduct the 
professional and holistic care they intended for their clients because of either a limited knowledge 
base to inform practice or a lack of options or choices for practice (Groenkajer, 2003). 

In order to investigate the desired scope of drug and alcohol education for undergraduate student 
nurses, a survey was developed for this study and conducted using rating scales, specifically trying 
to capture their attitudes towards their expected roles and their preparedness to assist others who 
use alcohol and tobacco. The study sought to ascertain if there was a difference between the 
perceived complexities of caring for others (as understood by undergraduate nurses) as a way of 
informing and constructing appropriate educational program to facilitate their nursing practice. In 
order to match simultaneously nurse self-confidence in the care of others who were substance 
dependent to the different levels of complexity of clinical practice, the partial credit model of 
Rasch scaling was used (Fox, 1999; Blackman, 2003). 

METHODS OF INVESTIGATION AND ANALYSIS 

Participants 

A total of 745 undergraduate nursing students were chosen for the study and it comprised 
representatives from all three years of the undergraduate degree in nursing, as shown in Figure 1 . 



Figure 1. Distribution of the undergraduate nursing students according to the stage of 
completion of undergraduate nursing studies 
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Figure 2 shows that female undergraduate nursing students were in the majority of the student 
sample group with just fewer than 12 per cent of students being male nursing students. This 
gender differentiation in undergraduate nursing programs was reasonably typical of the gender 
distribution in nursing, in Australia generally. 



Figure 2. Distribution of the undergraduate nursing students according to their gender 

The age composition of the undergraduate nurses employed in the research project ranged from 17 
years of age to the age of 56 years. Figure 3, shows the distribution of the undergraduate student 
group with the mean age of the group being just over 25 years of age. 


140 

120 



17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 


Age of nursing students (years) 

Figure 3. Distribution of the undergraduate nursing students according to student age 

While the majority of undergraduate nurses used in this research project were Australian born and 
used English as their first language, just over 13 per cent of the student group used English as a 
second language. A little over half of that group of undergraduate nursing students who used a 
language other than English, were likely to have had a northern European background, as students 
from Norway engaged in undergraduate nursing studies in Australia. Eigure 4 demonstrates this 
distribution. 
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Figure 4, Distribution of the undergraduate nursing students according to type of first 
language used 


Instrument Development 

A total of 57 test items were developed to form the basis of a eonfidential questionnaire to 
establish the undergraduate’s readiness to administer different aspeets of nursing eare to patients 
who were dependent on tobaeeo and aleohol. With ethieal eonsiderations taken into aeeount, 
undergraduates nursing students were asked to rate how easy or diffieult it would be for them to 
eomplete different aspeets of nursing eare. 

Eaeh of the 57 elinieal eonfidenee items used in the survey were formed as statements, followed 
by four ordered response eategories namely; a very simple task (eoded as 1), 2 an easy task (eoded 
as 2), or a hard task (eoded as 3): or 4 as the eode for a very diffieult task. This seale from 1 to 4 
ean be viewed as a eontinuum of inereasing nursing eare eomplexity as pereeived by the 
undergraduate nursing students. 

Table 1 identifies the eontent that underpins the questions seleeted for the survey. Two 
questionnaires were developed, one survey established student self-eonfidenee as it related to 
providing nursing eare to patients who were dependent on aleohol (41 items) and the other 
questionnaire, foeused on their eare towards another who was dependent on tobaeeo (16 items). 


Table 1. Overview of the content of the nurse clinical confidence (alcohol and tobacco use) 
questionnaire given to undergraduate nursing students 


Focus of the nurse clinical confidence 


Questionnaire item number(s) 


Elicits history of alcohol and tobacco use (including legal history) 
Recognises level of risk associated with alcohol or tobacco use 
Explores patient’s rationale for using alcohol or tobacco 
Recognises intoxification 
Identifies risk for alcohol or tobacco withdrawal 
Initiates activity to minimise alcohol or tobacco intake 
Estimates capacity to change drinking/ smoking behaviours 
Recognises patho-physiological effects of alcohol or tobacco use 
Provides care for the patient undergoing withdrawal symptoms 
Educates patient about community resources 


2 , 3 , 4 , 5 , 7 , 42 , 43 , 4445 , 

1 

6 , 

9,22 

8 , 14 , 15 , 16 , 17 , 18 , 32 , 49 , 

10 , 35 , 36 , 37,46 

12 , 13 , 33 , 34 , 47 , 4853 , 

11 , 23 , 30 , 38 , 39 , 40,5152 

19 , 20 , 21 , 24 , 25 , 2627 , 28 , 29 , 31 , 50 , 5455,56 

41,57 


Both questionnaires were developed with the adviee of experieneed health care professionals who 
worked in the area of drug dependence. 
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DATA ANALYSIS 

The Nurses’ Clinical Confidence Scale comprised 57 items that were used to survey participants’ 
affect, values and clinical confidence to nurse patients who were dependent on alcohol and or 
tobacco. Given that the scale used for the questionnaire was polytomous (a four point Likert scale 
having four categories) in nature, the partial credit model was used for data collection and 
analysis. The partial credit model had the advantage of not constraining response (also known as 
threshold levels also) categories between items allowing threshold levels to vary across each and 
all items. This model approach, estimated if distances between response categories were constant 
for each clinical confidence item and if the options for each clinical confidence item varied in the 
number of response categories (Bond and Fox, 2001). 

RESULTS 

Scale Validity 

While the nurses’ clinical confidence scale contained 57 items, some measurement of the validity 
of the instrument was warranted. Unidimensionality is a requirement underpinning the Rasch 
model and it seeks to ensure that all test items used in the surveys to construct the nurses’ clinical 
confidence scale, reflect the same underlying construct. If items are not seen to reflect a common 
clinical confidence construct, they are reviewed by the researcher and either modified or removed 
from the instrument (Hambleton, 1991; Linacre, 1995; Smith, 1996). In order to test for scalability 
of the data, the QUEST program (Adams and Khoo, 1996) was employed. The two main 
goodness of fit indices used in the analysis are the unweighted (or the outfit means square) index 
and the weighted (or infit means square) index. Both are a form of chi-square ratios, which 
provide information about discrepancies between the predicted and observed data given by the 
nursing students, particularly in terms of the size and the direction of the residuals for each 
clinical confidence items being answered. Fit values are calibrated around a mean of zero and are 
either positive or negative, depending whether the observed values show greater variation in 
responses than expected (greater variation showing a positive value and less variation as a 
negative value). In this way, the compatibility of the data obtained from the clinical confidence 
scale can be monitored against the Rasch model requirements. With reference to Figure 5, which 
represents the fit model of all clinical confidence items completed by nursing students, not all the 
survey items fit the Rasch model. From Figure 5, ten nurse clinical confidence items do not fit the 
Rasch model as their fit indices are exceeding their parameters (infit means square values should 
not be greater than 1.30 or less than 0.77). Table 2 highlights the content of the poorly fitting 
items. When re-examining student nurses’ responses to these survey items, it was noted that some 
nursing students rated all the survey questions with extreme responses (rating with either 1 or 4) 
only. A considerable number of students tended to rate the clinical confidence questions with 
numbers of 2 or 3 only, with no items being either very simple or very difficult. If there are any 
major deviations in the students’ responses compared to what the Rasch model expectations are, 
the item reliability index alerts the researcher to the fact that either the student nurses may not be 
responding as accurately as possible. Alternatively poorly fitting items could be just the result of 
poorly worded survey questions and students misinterpreting the underlying focus of the question. 

Given that 10 of the 57 items are not fitting the Rasch model, it is essential at this point, to review 
these items because while it may seem logical or appropriate for these items to be in the survey 
overall from the researcher’s perspective, students are not responding according to the Rasch 
model’s expectations and unless the source of why the items are not fitting and corrected, the 
poorly fitting items need to be rejected from future surveys and restricted in their use in the 
analyses undertaken in this study. 
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Figure 5. Misfitting clinical confidence survey questions 

Table 2, 

Student nurses’ clinical confidence survey questions not fitting the Rasch model 


Question Focus of the clinical confidence statement 

1 Understands alcohol use and low level risk to health 

2 Elicits if patient drinks alcohol 

3 Takes a patient’s history about alcohol use 

1 7 Evaluates the severity of alcohol withdrawal 

18 Records observations related to alcohol withdrawal 

32 Understands relationship between falling blood alcohol level and withdrawal 

35 Responds to patient acknowledgement that changing drinking behaviour is difficult 

54 Provides advice about nicotine replacement therapy 

55 Gives advice about strategies to decrease smoking 

56 Educates patient about nicotine addiction 
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Differential Item Functioning 

Procedures are often used to investigate whether individual survey questions funetion differently 
for different groups of respondents. Sueh differentiation ean oeeur aeeording to the respondent’s 
gender, age, past experienee and racial or ethnic background. By using item response theory to 
identify item bias or differentiated item funetioning (DIF), the estimated parameters of the item 
response function are kept constant for different samples drawn from a student population. DIF is 
employed to see if the probability of nursing student responses, and falls into a partieular eategory 
(very easy to very diffieult) for eaeh survey question is the same for different groups of nursing 
students of the same ability levels (Seheuneman and Bleistein, 1988). If this is not the ease, then 
the partieular survey question ean be said to be biased in favour of one portion of the student 
group over another, and should be reviewed and possibly disearded from future surveys. 

In referenee to Figure 6, it ean be seen that the 57 elinieal eonfidenee survey items are eompared 
aeeording to the type of first language used by nursing students undertaking the elinieal 
eonfidenee survey. The seale aeross the top of the figure ranging from -4 to 0 then through to +5, 
indieates the number of standard deviations the student nurses’ responses to each survey question 
is away from the mean (loeated at zero). Any elinieal eonfidenee survey question that lays two or 
more spaees to the left or right of zero, are seen as being statistieally signifieant aeeording to the 
nursing students’ first language usage. 

Three elinieal eonfidenee questions were identified as being signifieantly easier for non-English 
speaking baekground nurses to undertake than native English speaking nurses. These ineluded 
taking a history to establish if the person used aleohol regularly, feeling eonfident to stay with an 
agitated patient who was detoxifying and providing eounselling about eeasing smoking. 
Conversely, six items were rated as being easier for native English speaking nurses eompared to 
those who use English as a second language. They inelude assessing the effects of medication 
used for aleohol withdrawal, understanding the effeets of aleohol use on the nervous system, 
reeognising the assoeiation between aleohol use and liver disease, differentiating between the 
effeets of aleohol and other types of illnesses, being able to assist the their when drinking 
behaviour is out of eontrol and understanding the relationship between heavy drinking and mental 
health eo-morbidity. 

Nine elinieal eonfidenee items are statistieally signifieant in differentiating for the student’s 
language use and these items should be reviewed and careful consideration given to the 
interpretation of any future ratings given for this items by future respondents. 

With referenee to Eigure 7, only one elinieal eonfidenee survey item is signifieantly differentiating 
aeeording the gender of the student nurse. Being able to deseribe the aeute effects of alcohol on 
the eentral nervous system has been estimated as being easy for female nursing students than for 
their male eounterparts. 


Item Threshold Values 

How eomplex the student nurses have rated the different aspects of nursing care is depicted in 
Eigure 8. As mentioned, with partial eredit model it is assumed that threshold values (or the 
spaees between the eategories) are different within eaeh individual elinieal eonfidenee survey 
question itself and aeross all the elinieal eonfidenee survey questions too. The assumption of 
equidistanee between the categories or thresholds of the elinieal eonfidenee rating seale is not held 
by the Raseh’s partial eredit model. The logit seale is plotted on the left of the histogram (in 
Eigure 8) and survey question numbers to the right but now, eaeh survey question number has an 
additional dot point after eaeh question number (either a.l, a.2 or a.3), whieh refleets the threshold 
value (and inereasing eomplexity) for that elinieal confidence question. 



252 


Mapping self-confidence levels of nurses using Rasch scaling 


Easier for English-speaking nurses Easier for nurses who use English 

as a second language 



-4 -3 

-2-1 01 

2 

3 4 5 

item 

1 



* 

item 

2 

1 



item 

3 

1 

* 


item 

4 

1 



item 

5 

1 



item 

6 

1 * 



item 

7 

1* 



item 

8 

1 



item 

9 

1 


♦recog regular ale intake 

item 

10 

* 1 



item 

11 

1 



item 

12 

• * 1 



item 

13 

1 * 



item 

14 

1 

* 


item 

15 

1 



item 

16 

1 



item 

17 

1 



item 

18 

*1 



item 

19 

*• 



item 

20 *assess 

effect med withdrawal 



item 

21 

1 * 



item 

22 

1 

* 


item 

23 

.♦effects of ale on n/system 



item 

24 

1 



item 

25 

1 



item 

26 

1 


♦stay agitated pt 

item 

27 

1 



item 

28 

1 



item 

29 

1 



item 

30 * 

recog signs liver disease 



item 

31 *alc effects 

and life illness | 



item 

33 

1 * 



item 

36 

* 1 



item 

37 

.♦help when drink out of control 



item 

38 

♦heavy drink and psyche morbidity 



item 

41 

1* 



item 

44 

1 



item 

45 

1 



item 

46 

1 



item 

48 

1 

♦ . 

counsel about smoking 

item 

49 

1 * 



item 

50 

1 



item 

53 

• * 1 



item 

54 

* 1 



item 

55 

* 1 



item 

56 

1 



item 

57 

1 




Figure 6, Student nurses’ clinical confidence survey questions differentiating for the type of 
language used, plotted using the standardised difference 

A most difficult nursing task for student nurses to undertake was item No. 35 whieh assessed their 
ability to respond to the patient who acknowledges to the nurse, that giving up drinking behaviour 
is very difficult. Note the thresholds for this item are well spaeed with the first threshold loeated 
on the logit seale at -2.50, the seeond threshold at +0.8 and the last threshold on the logit seale at 
+5.0. This suggests that there is equal probability that student nurses view this item as either being 
very easy or simple to eomplete, or the item is seen as either an easy or difficult task to undertake 
or viewed as being a hard to very difficult to negotiate. This is a similar pattern for item No. 32, 
which explores a student’s eonfidenee in recognising the relationship between the patient’s falling 
blood aleohol level and possible impending aleohol withdrawal. The first threshold oeeurs at -1.7, 
the second threshold at +1.2 and the third threshold at +4.8. With both these items, the thresholds 
are spread widely up the seale ability seale, elearly differentiating between the eonfidenee levels 
of students and how complex they see these two elinical activities. This is not a uniform pattern 
aeross all elinical confidence survey questions. Note how survey question number 42 (determines 
if a patient smokes eigarettes or tobaeco) has a different threshold eonfiguration. The first 
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threshold is located at logit -4.8, the second threshold at -3.0 and the last threshold at +1.0. For 
this survey question, there is less probability that student nurses will score between the second and 
third thresholds, but are more likely to rate themselves (their confidence level) and the task 
complexity as being between the first and second thresholds. This suggests that students probably 
see this as a simple task requiring little ability on their part because the threshold levels of 42.1 
and 42.2 are located closely together in the lower end of the logit scale and the 42.3 threshold 
level is located near zero on the logit scale. 
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Figure 7, Student nurses’ clinical confidence survey questions differentiating for the gender 
of student nurses, plotted using the standardised difference 

In contrast to this pattern is survey question No. 40, which explores the student nurse’s ability to 
recognise Korsakoff s syndrome. Note the first threshold is located at logit -0.4, the second 
threshold at +2.0 and the last at +3.5. This is a most difficult task for students as the threshold 
levels 40.1 and 40.2 are located to the middle and upper part of the logit scale, which usually 
suggests that students believe greater ability, is required on their part to carry out what they see as 
a complex task. 

The Rasch model is able to place all the surveyed nursing activities identified by student nurses on 
a scale ranging from the more complex to the most simple. Figure 9 depicts this hierarchy. Those 
nursing activities located opposite the zero logit value, extend upwardly to approximately to logit 
area +0.50 and downwardly to logit area -0.50, are viewed as being of average complexity by the 
student nurse with average ability. Nursing activities located adjacent to the logit scale of -0.50 
and below, are perceived to be very easy nursing activities requiring minimal skill in order to 
complete them. Conversely, nursing activities locate above logit +0.50 reflect a greater probability 
that the student nurse with average ability is likely to find these nursing activities becoming 
increasingly harder for them to undertake, believing instead they need greater abilities to practise 
these skills. It is this conjoint scaling that allows student confidence levels to be directly measured 
against the complexity of the nursing tasks that is the hallmark of Rasch scaling and serves as a 
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foundation on how to direct training to maximise nursing care. It is also important to note that 
both the nurses and the tasks are located on an interval scale that extends theoretically to ±oo. 
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Figure 8, Clinical confidence item threshold map differentiating between the student nurses’ 
perceived confidence levels and the complexity of nursing practices 
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Figure 9, Item map indicating student nurse clinical confidence levels for different clinical 
nursing practices 


DISCUSSION 

Any education program that helps undergraduate nurses to care for others who are dependent on 
nicotine or alcohol, needs to address the contrasting requirements in terms of the students’ 
capacity or preparedness to provide nursing care and the differing degrees of complexity of the 
care that is required to be undertaken. This study has shown that different nursing care 
requirements are perceived by students as needing greater or lesser preparation on their part, in 
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order to deliver that eare. These demands have direet impaet on what should be ineluded in a 
eurrieulum that facilitates nursing care. It is clear that students without sufficient educational input 
would experience considerable difficulty not only in recognising, but also in providing 
interventions for others who have experienced brain damage associated with long term alcohol 
abuse. Additionally, nursing students find it very difficult to differentiate between alcohol 
withdrawal and other types of life-threatening illnesses. It is suggested that these outcomes should 
help inform educators what should be included in any future training programs to enhance a 
nurse’s sense of improved efficacy. The relationships between mental health problems and 
dependence on alcohol and tobacco are not well understood by student nurses and this suggests 
that the curriculum needs to emphasise more co-morbidity presentations. Similarly, understanding 
withdrawal regimes are seen as difficult tasks for student nurses to do also. This suggests also that 
the curriculum needs to focus more fully on how client withdrawal is manifested and why 
interventions are carried out. As these nursing tasks are perceived as being very difficult for 
student nurses to act upon, it is recommended that considerable educational effort (using multiple 
methods of teaching and learning) and thought is put into making these skills easier for student 
nurses to undertake. Conversely, nursing students have indicated that identifying patterns of 
alcohol and tobacco use and understanding why others use these substances as being very simple 
tasks for them to do. Identifying and advising others of community resources that could help with 
alcohol and tobacco dependence was also rated by students as being easy tasks for them to 
complete. In terms of making decisions about how urgent is it that these elements are integrated 
into a curriculum (given students have rated these simplistically), educators may wish to consider 
how else students can learn more about these issues (e.g. fostering student self-direction) 
individually rather than committing valuable didactic time to this content area). 

Students in this sample also indicated that it would not be overtly difficult to provide nursing care 
in order to calm an agitated patient who is experiencing withdrawal. This is an interesting 
outcome given student nurses earlier acknowledged that they find the rationales for withdrawal 
management difficult to understand, yet they perceive the actual care of managing the 
withdrawing client as being more easy. Survey questions that were rated as being most simplistic 
for student nurses to attend to should be explored by educators with a view to generating criterion- 
referenced assessments that can be used to measure students’ capacity to deal successfully with 
those aspects of care that students rate as being easiest to do. In this context, the clinical 
confidence scales as developed in this research assist in developing appropriate student clinical 
assessment tools. 

Much of the literature about nurses’ attitudes towards others who are substance dependent has 
indicated that the nurses’ affect and thinking needs to be modified if nursing care is to improve. 
Educational strategies therefore need to have a strong affective component (Flaskrud, 1991). In 
order to have this effect, it is likely that very short courses are of limited value (Fennel, 1991). 
Educational programs that are conducted over several weeks, which call for active participation, 
group discussions and simulations, allow for gradual development of the student nurses’ self- 
awareness and sensitivity (Martinez and Murphy-Parker, 2003). Moreover, allowing nursing 
students exposure to actual clinical events and interaction with patients who are substance 
dependent may be expected to maximise student learning (Byrnes and Kiger, 1990) and (Stein, 
2003). 

More research is needed into the relationship between student nurse confidence and care delivery 
especially since the type of first language used by the student nurse has a significant effect on the 
confidence to provide different aspects of nursing care. Additionally, student nurses’ attitudes 
towards the care of others who use illicit drugs is another area in which Rasch scaling can be used 
to inform the curriculum and complement the outcomes demonstrated by this research. 
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CONCLUSIONS 

It is argued in this paper, that Raseh sealing analyses offers a great deal for the development and 
analysis of rating seales, whieh in turn serve to give reliable information to edueators about 
eurriculum eontent and proeesses, as they relate to aleohol and tobaeeo nursing eare. There are 
limitations to using traditional analytieal proeedures in the examination of rating seales whieh are 
overeome when Raseh sealing is used to measure eonjointly the eomplexity of nursing eare with 
eonfidenee levels and abilities estimates of student nurses’ engagement in the learning proeess. By 
employing the partial eredit model, the edueational researeher is no longer eonstrained by the 
assumption that rating seale eategories are statie or uniformly estimated aeross each item or 
survey question. Instead rating scales can be visualised as an interval scale continuum of student 
nurse self-confidence which, when used on multiple occasions can be a valuable adjunct to see if 
learning has taken place. Test item validity can also be employed in Raseh analysis by examining 
survey tasks for unidimensionality. In total, item response theory works well to inform educators 
about curriculum content, processes and to estimate if learning is taking place because Raseh 
scaling remains robust in its approach to developing and evaluating educational data generated by 
using rating scales. 
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